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Description 

STORAGE MEDIUM FOR RECORDING SUBTITLE IN- 
FORMATION BASED ON TEXT CORRESPONDING TO 
AV DATA HAVING MULTIPLE PLAYBACK ROUTES, 
REPRODUCING APPARATUS AND METHOD THEREFOR 

Technical Field 

[1] The present invention relates to reproduction of storage roedum recordng moving 

picture (fata, and more particularly, to a storage medum recordng subtitle information 
compatible with a subpicture method of a dgital versatile disc (DVD) and a pre- 
sentation method of a bluray dsc, and based on text corresponding to moving picture 
data having a plurality of playback routes, and a reproducing apparatus and a re- 
producing method therefor. 

Background Art 

[2] Among conventional text-based subtitle technologies there are Synchronized 

Accessible Meda Interchange (SAMT) technology of Microsoft and Real-text 
technology of RealNetwork. These conventional text-based subtitle technologies are 
based on a video stream data file recorded on a storage medum or a video stream (fata 
file provided on a network, and have a structure in which a subtitle is output on the 
basis of synchronization time information with video data. 

[3] FIG. 1 is a reference diagram explaining the conventional text-based subtitle 

technology. 

[4] Referring to FIG. 1 , there is a text-based subtide file correspondng to video stream 

data, and on the basis of synchronization time information included in a subtide file, 
for example <sync time 00:05>, the subtide corresponding to video stream data is 
output 

[5] That is, the conventional text-based subtide information provides a subtitle file 

structure constructed assuming that continuous video dhta is reproduced 

[6] FIG. 2 is a reference diagram explaining problems of the conventional text-based 

subtitle technology. 

[7] Referring to FIG. 2, with the conventional text-based subtitle file structure, there is 

a problem that when multiple story video having a plurality of playback routes is 
reproduced according to a user input, processing subtitles is impossible as shown in the 
figure. That is, only story route A can be reproiice4 and story route B cannot be 
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reprodbced. 

In aiition, there is another problem that the conventional text-based subtitle data 
is not compatible with subtitle (fata based on a bitmap image such as a subpicture 
method of a DVD or a presentation method of a bluray disc. 

Disclosure of Invention 

Technical Problem 

There is a problem that when multiple story video having a plurality of playback 



routes is r 



1 according to a user input, processing subtitles is impossible. In 
actttion, there is another problem that the conventional text-based subtitle (fata is not 
compatible with subtitle data based on a bitmap image such as a subpicture method of 



a DVD or a presentation method of a bluray disc. 
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To solve die above problems, it is a first objective of the present invention to 
provide a storage medum recortfng subtitle information compatible with a subpicture 
method of a DVD and a presentation method of a bluray dsc, and based on text cor- 
responding to moving picture data having a plurality of playback routes, and a re- 
producing apparatus and a reproducing method therefor. 

To accomplish the first objective of the present invention, there is provided a 
storage medum induing: moving picture data having a plurality of playback routes; a 
plurality of subtide chta hems correspondng to the playback routes and supporting 



g the moving picture (fata 



« * 



in- 



random search for a subtide; and mapping information I 
and die subtitle (fata. 

The subtitle data may include reference offset information indicating refi 
formation to randomly search for a subtitle of a desired time at a high speed and 
reproduce the subtide, text data containing subtide contents that are convened into 
pixel data and output, style information specifying an output style of the pixel (fata, 
and control information to control the. output of the converted pixel data. 

By using information on a time elapsed from the reference offset information, the 
subtitle of a desired time may be randomly searched for at a high speed among the 
subtide (fata. 

The reference offset information may include a cell identifier (VOBJD and 
CELLJD) of a video object that is a recordng unit of the storage medum, or a start 
position of a dip that is a reconing unit of the storage medum. 

Hie subtide (fata may be described in the form of a markup language or a binary 



table. 
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[16] In the subtitle (fata described in the form of a binary table, the style information, 

the control information, and the text information may have respective identifiers for 
distinguishing each other, and the control information may include inci cation in- 
formation indicating the style information and the text information corresponding to 
the control information, and in order to reduce a search time by integer calculation 
when rancfom search is performe4 die size of each of die style information and the 
control information may be predetermined and sequentially recorded in a pre- 
determined area. 

[17] The style information may include at least one among information items on the 

width and height of the pixel (fata area, a background color, a time when the pixel chta 
is to be stored and deleted in a buffo memory, a starting point from which subtitle text 
is rendered line spacing, output direction, bold type and Italic type of subtitle text, line 
break, color of subtitle text, and information on character code encoing. 

[ 1 8] The control information may include at least one among information items on an 

area on which the pixel data is to be output on the entire screen, a start point of subtitle 
text in the area, and a synchronization time ind eating when the pixel data is to appear 
and disappear in synchronization with die moving picture (fata. 

[19] The the synchronization time information may be expressed as a lapse time from a 

reference cell (CELL) of a video object (VOBU) that is reference offset information of 
the moving picture (fata, cm- as a lapse time from a start position of a clip that is 
reference offset information of the moving picture (fata. 

[20] The synchronization time information may be expressed by using a present time 

stamp (PTS) time on the baas of a reference time for reproducing moving pictures. 

[21] The subtitle (fata or mapping information may further include at least one among 

font information describing the font of subtitle (fata to be displayed on the screen, in- 
formation on a producer making the subtitle, packet identifier (PID) information of the 
subtitle data to distinguish from the moving picture (fata, and subtitle indication in- 
formation by language of the subtitle data. 

[22] To accomplish the second objective of the present invention, there is provided a re- 

producing apparatus for reproducing a storage medium on which moving picture data 
is recorded the apparatus induing: a decoder decaing moving picture data having a 
plurality of playback routes; and a subtitle processor converting subtitle cfata cor- 
responding to a predetermined route and selected by using a plurality of subtitle (fata 
items corresponding to the playback routes and supporting random search for a subtitle 
and mapping information linking the moving picture data and the subtitle (fata, into 
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pixel data, and synchronizing the converted pixel data with the moving picture data 
ami outputting the pixel (fata. 

[23] The subtitle processor may include: a text subtitle decoder identifying subtitle data 

corresponding to the moving picture (fata of a route to be reproduced by parsing the 
mapping information, and converting the identified subtitle data into pixel data by 
parsing the subtitle data; and a graphic controller controlling the pixel (fata by using 
the parsed mapping information and subtitle data such that the pixel (fata is syn- 
chronized with the moving picture (fata and output 

[24] In the subtitle (fata, by decodbog the subtitle (fata, the text subtitle decoder may 

parse reference offset information indicating reference information to randomly search 
for a subtitle of a desired time at a high speed and reproduce the subtitle, text data 
containing subtitle contents that are converted into pixel (fata and output, style in- 
formation specifying an output style of the pixel data, and control information to 
control the output of the converted pixel data, and based on the style information, 
convert the text (fata into pixel data, and by using the parsed control information, the 
graphic controller may control such that the converted pixel (fata is synchronized with 
die moving picture (fata and output 

[25] The text subtitle decoder may randomly search the subtitle data for the subtitle of a 

desired time at a high speed by using information on a time elapsed from the reference 
offset information. 

[26] By using synchronization time information expressed as a lapse time from a 

reference cell (CELL) of a video object (VOHJ) that is reference offset information of 
the moving picture (fata, or as a lapse time from a start position of a clip that is 
reference offset information of die moving picture data, the graphic controller may 
control the converted pixel data to be synchronized with the moving picture (fata and 
output 

[27] Also, to accomplish the second objective of the present invention, there is provided 

another method for reproducing (fata on a storage medium storing moving picture (fata 
having a plurality of playback routes, a plurality of subtitle (fata items carrespondng to 
the playback routes and supporting random search for a subtitle, and mapping in- 
formation Unking the moving picture data and the subtitle (fata, the method induing: 
reading the subtitle data corresponding to moving picture (fata of a route to be 
reproduced by parsing the mapping information; identifying subtitle data of a position 
to be reproduced according to continuous reproduction or reproduction by random 
search, by parsing the subtitle data, and converting the subtitle data into pixel data; and 
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synchronizing the converted pixel (fata with the moving picture (fata and outfitting the 
pixel (fata. 

Advantageous Effects 

[28] By using the mapping information and the subtitle (fata file structure according to 

the present invention, subtitle information compatible with a bitmap image method 
such as the subpictme method of a DVD and the presentation method of a bluray disc, 
and based on text correspondng to moving picture (fata having a plurality of playback 
routes can be provided. 

[29] Furthermore, by induing reference offset information in a subtitle (fata file, when 

random search or reproduction is performed the time for searching for a subtitle can 
be reduced such that search efficiency can be enhanced. 

Description of Drawings 

[30] FIG. 1 is a reference diagram explaining the conventional text-based subtitle 

technology; 

[31] FIG. 2 is a reference diagram explaining problems of the conventional text-based 

subtitle technology; 

[32] FIG. 3 is a reference diagram explaining text-based subtitle information cor- 

responding to moving picture cfeta having a plurality of playback routes accordng to a 
preferred embedment of the present invention; 

[33] FIGS. 4 through 10 are dagram explaining mapping information of moving picture 

data and subtitle data having a plurality of playback routes and the structure of subtitle 
(fata accordng to a preferred embedment of the present invention; 

[34] Also, FIGS. 1 1 through 17 are dagrams explaining an implementation example of 

mapping information and subtitle (fata implemented on a DVD dsc as a preferred 
embedment of the present invention; 

[35] Meanwhile, FIGS. 18 through 24 are dagrams explaining an implementation 

example of mapping information and subtitle (fata implemented on a bluray dsc as 
another preferred embadment of the present invention; 

[36] More specifically, FIG. 4 is a dagram explaining mapping information of moving 

picture (fata and subtitle data having a plurality of playback routes accordng to a 
preferred embedment of the present invention; 

[37] FIG. 5 is a dagram explaining subtitle indcation information by language cor- 

respond g to moving picture data having a plurality of playback routes accordng to a 
preferred embedment of the present invention; 

[38] FIG. 6 is a dagram explaining the structure of subtitle data accordng to a 
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preferred embedment of the present invention; 
[39] FIG. 7 is a diagram explaining a usage example of each field of subtitle data 

having the data structure of FIG. 6; 
[40] FIG. 8 is a diagram explaining die structure of a reprodbcing apparatus according 

to a preferred embodiment of the present invention; 
[41] FIG. 9 is a dagram explaining the structure of a subtitle processor of FIG. 8 in 

detail; 

[42] FIG. 10 is a flowchart of the steps performed by a reproducing method for 

providng subtitle information based on text corresponding to moving picture data 
having a plurality of playback routes accordng to a preferred embedment of the 
present invention; 

[43] FIG. 1 1 is a dagram explaining the data structure of mapping information shown 

in FIG. 4 implemented on a DVD disc as an embedment of the present invention; 

[44] FIG. 12 is a dagram showing an example of mapping information shown in FIG. 

1 1 implemented by using a markup language on a DVD dsc as an embedment of the 
present invention; 

[45] FIG. 13 is a dagram showing an example of the mapping information described in 

die form of a table implemented on a DVD dsc as an embedment of the present 
invention; 

[46] FIG. 14 is a dagram explaining the structure of subtitle tfata shown in FIG. 6 im- 

plemented on a DVD dsc as an embedment of the present invention; 

[47] FIGS. 15A and IS are dagrams showing an example of subtitle data im- 

plemented on a DVD dsc dsplayed on a screen as a preferred embodiment of the 
present invention; 

[48] FIG. 16 is a dagram showing an example of subtitle data implemented by a 

markup language on a DVD dsc as an embedment of the present invention; 
[49] FIG. 17 is a dagram showing an example of subtitle data implemented in the form 

of a binary table on a DVD dsc as an embedment of the present invention; 
[SO] FIG. 1 8 is a dagram explaining the (fata structure of mapping information shown 

in FIG. 4 implemented on a bluray dsc as another embedment of the present 

invention; 

[51] FIG. 19 is a dagram showing an example of mapping information shown in FIG. 

18 implemented by using a markup language on a bluray dsc as another embedment 

of the present invention; 
[52] FIG. 20 is a dagram showing an example of the mapping information described in 
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FIG. 23 is a dagram showing an example of subtitle data implemented by a 
markup language on a bluray dsc as another emboiment of the present invention; and 

FIG. 24 is a dagram showing an example of subtitle (fata implemented in the form 
of a binary table on a bluray dsc as another embedment of the present invention. 

Best Mode 

FIGS. 3 through 10 are dagram explaining mapping information of moving picture 
data and subtitle data having a plurality of playback routes and the structure of subtitle 
data accordng to a preferred eml 



u»:m hi hi 



ion. 



it of the present inve 
Also, FIGS. 11 through 17 are dagrams explaining an implementation example 
mapping information and subtitle (fata implemented on a DVD dsc as a preferred 
embedment (1 ) of the present invention. 

Meanwhile, FIGS. 18 through 24 are dagrams explaining an implementation 
example of mapping information and subtitle data implemented on a bluray dsc as 
another preferred embedment (2) of the present invention. 



First, accordng to a preferred eml 



aent of the present invention, a storage 

ig to moving picture 
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medum recordng subtitle information based on text cones] 
data having a plurality of playback routes, and a reproducing apparatus and a re- 
producing method therefor will now be explained. 

The storage medum accordng to a preferred emboiment of the present invention 
has a structure induing moving picture data having a plurality of playback routes for 
multiple story playback, a plurality of subtitle data items correspondng to the plurality 
of playback routes and supporting random search for a subtitle, and mapping in- 
formation linking the moving picture (fata and subtitle (fata described above. 

FIG. 3 is a reference dagram explaining text-based subtitle information cor- 
respondng to moving picture data having a plurality of playback routes accordng to a 
preferred embodiment of the present invention. 

Referring to FIG. 3, in order to select and reproduce story A route or story B route 
for multiple story playback, video (fata A and video (fata B are linked to vkleo data C. 
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FIG. 4 is a diagram explaining mapping information of moving picture (fata and 
subtitle data having a plurality of playback routes according to a preferred embodiment 
of the present invention. 

Referring to FIG. 4, shown is mapping information for linking moving picture data 
having a plurality of playback routes and a plurality of subtitle (fata corresponding to 
die moving picture (fata in order to 
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information on the left hand side includes indication information for subtitle (fata items 

According to 

this, whichever a user selects between playback A route and playback B route, vkleo 
data and the corresponding subtitle can be output continuously. 

FIG. 5 is a dagram explaining subtitle indcation information by language cor- 
responding to moving picture data having a plurality of playback routes according to a 
preferred embedment of the present invention. 

Referring to FIG. 5, subtitle indcation information by language accordng to the 
present invention indcates related mapping information for indvidual subtitle 
languages supported 

Also, the mapping information indcates a plurality of subtitle (fata items cor- 
responding to a plurality of playback routes, respectively, as described above with 
reference to FIG. 4. 

For example, as shown in FIG. 5, if in a storage medum providng English, 
Korean, and Japanese subtitles, Korean subtitle is selected by a user selection, or as a 
set default, by the pointer of related mapping indcation information, subtitle/video 
mapping information Y supporting Korean subtitle is linked. Also, a plurality of 
subtitle data A through C written in the correspondng language Y, that is, in Korean, 
are linked to A through C video data items having a plurality of playback routes 
inclided in subtitle/video mapping information Y, respectively. Accordngly, multiple 
language subtitles are supported and at the same time, multiple story playback of 
moving picture data having a plurality of playback routes is enabled. 

FIG. 6 is a dagram explaining the structure of subtitle (fata accordng to a 



preferred embedment of the present invention. 

Referring to FIG. 6, shown is the structure of a plurality of subtitle cfata linked by 
related subtitle indcation information included in the subtitle/video mapping in- 
formation described above with reference to FIG. 4. 

The subtitle (fata accordng to a preferred embedment of the present invention 
includes header information, reference offset information, time information and/or text 
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information. 

[73] First, header information is information on the entire subtitle data and may include 

position information of a subtitle to be displayed on a screen, and international 
standud record code (hereinafter referred to as ISRC) as information cm a producer or 
a support language code. 

[74] Reference offset information is reference information for randomly searching for a 

subtitle of a desired time at a high speed and reproducing the subtitle. A cell identifier 
(VOBJD and CELLJD) of a video obj ect (VOBU) used as a recording unit of a 
DVD storage medium, or the starting point of a clip used as a recordfatg unit of a 
bluray disc storage medium can be used as reference offset information. 

[75] Synchronization time information synchronising a subtitle with video data can be 

expressed as a lapse time from a starting point of a reference cell of a VOBU or a clip 
that is reference offset information of moving picture data. In particular, syn- 
chronization time information can be expressed by using a presentation time stamp 
(hereinafter referred to as PTS) time on the basis of a reference time for reprodicdng 
moving pictures. 

[76] Text information indcates text (fata containing subtitle contents to be converted 

into pixel data to present a bitmap image of the text subtitle and output 

[77] Also, the text information may include style information specifying the output style 

of pixel data and control information for controlling the output of die converted pixel 
data. The style information and control information will be explained later. 

[78] FIG. 7 is a dagram explaining a usage example of each field of subtitle data 

having the cfala structure of FIG. 6. 

[79] Referring to FIG. 7 f subtitle data accardng to a preferred embodiment of the 

present invention includes position information of a subtitle to be displayed on a 
screen, a language cade and/or ISRC information as header information. Also, the 
subtitle <hta includes a plurality of synchronization tune information items syn- 
chronizing the subtitle with video data, and a plurality of text information items of a 
subtitle to be used as subtitle contents. Furthermore, the subtitle (fata includes 
reference offset information for random search for a subtitle, and each reference offset 
information item indcates an immedate next reference offset information item. Ac- 
cordingly, by using reference offset information, a subtitle can be searched for at a 
high speed and synchronization time information for synchronizing a subtitle with 
video data can also be expressed by a lapse time from reference offset information. 

[80] The storage medum according to the present invention as described above 
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includes moving picture data having a plurality of playback routes, a plurality of 
subtitle data corresponding to the plurality of playback routes, and subtitle/video 
mapping information for multiple story playback Also, subtitle ckta includes reference 
offset information for high speed random search. In aHtion, in order to support 
multiple language subtitles, subtitle indcation information by language can be further 
included. The subtitle/video mapping information, subtitle {fa ta, and subtitle indcation 
information by language above described can be recorded as files separate from 
moving picture data, and can be recorded on an identical storage medum on which 
moving picture (fata is recorded or can be recorded separately in a server or the like on 
the Intranet 

[81] Based on the data structure of the storage medum described above, the structure of 

a reproducing apparatus accordng to the present invention will now be explained. 

[82] FIG. 8 is a dagram explaining the structure of a reproducing apparatus accordng 

to a preferred embedment of the present invention. 

[83] Referring to FIG. 8, the reproducing apparatus accordng to the present invention 

includes a readng unit 810, a decoder 830, a subtitle processor 840, and a blender 850. 
Also, the reproducing apparatus may further include a buffer unit 820 temporarily 
storing (fata for buffering (fata. 

[84] The reading unit 810 reads each data item having the (fata structure described 

above from a storage medum or from the Internet 800, and dependng on the type of 
each dfata item, store the data in a correspondng buffer unit 820. That is, AV stream 
(fata is stored in a moving picture data buffer 822, a plurality of subtitle data items cor- 
respondng to a plurality of playback routes (Refer to FIG. 6) are stored in a subtitle 
data buffer 824, and subtitle/video mapping information (Refer to FIG. 4) and subtitle 
indcation information by language (Refer to FIG. 5) are stored in the corresponding 
buffer 826. Furthermore, font information of a subtitle is stored in a default font buffer 
828. Meanwhile, a resident font buffer 842 storing a resident font read from a storage 
medum or from the Internet and residing on a memory can also be disposed 

[85] The decoder 830 decodes video stream (fata stored in the moving picture (fata 

buffer 822 and transmits moving pictures to be output to the blender 850. 

[86] The subtitle processor 840 generates a graphic image of a subtitle to be overlaid on 

moving pictures to be output, and controls the output of a subtitle to be synchronized 
with video (fata. 

[87] That is, the subtitle processor 840 receives subtitle (fata from the subtitle data 

buffer 824, receives mapping information from the subtitle/video mapping information 
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buffer 826, and identifies subtitle data corresponing to moving picture data cor- 
responding to a selected language and a selected story route. By decoing the subtitle 
data, the subtide processor 840 converts (or renders) the subtitle data into pixel (fata 
for a bitmap image and transmits the pixel (fata to the blender 850. At this time, by 
using style information included in the subtitle data, the output style of the subtitle can 
be controlled^ and by using control information included in the subtitle data, an output 
time can be controlled to be synchronized with video data. 
[88] Pont information stored in the default font buffer 828 and/or the resident font 

buffo- 842 can be used. A detailed structure of the subtitle processor 840 will be 
explained later. 

[89J Rendering in the present invention indicates all required activities related to 

converting subtitle text data into graphic data to express the text data on a display 
apparatus. That is, it indicates all processes for finding a font matching a character 
cede of each character in text data, from download font data read from an information 
storage medium, or from the resident font data, converting into a graphic, and 
outputting on a screen. 

[90] The blender 850 receives decoded video data from the decoder 830, receives 

converted pixel (fata from the subtitle processor 840, overlays the pixel (fata of a 
subtitle on an image based on the video data, and outputs to the display apparatus 860. 

[91] FIG. 9 is a diagram explaining die structure of the subtide processor 840 of FIG. 8 

in detail. 

[92] Referring to FIG. 9, the subtitle processor 840 accoring to the present invention 

includes a text subtide decoder 902 and a graphic controller 904. 

[93] The text subtide decoder 902 receives subtide (fata, subtideArideo mapping in- 

formation, other language information, and font information from the buffers 824 and 
826 described above, parses subtitle/video mapping information, identifies subtitle 
data corresponding to moving picture data of a route to be reproduced parses the 
identified subtide data, and converts the subtide data into pixel (fata for a bitmap image 
graphic. 

[94] By using the subtitle/video mapping information and subtide (fata parsed by the 

text subtide decoder 902, the graphic controller 904 controls an output time and 
position of the converted pixel cfata such that the converted pixel data is output syn- 
chronized with moving picture data. 

[95] More specifically, the text subtide decoder 902 decodes subtide data, and parses 

reference offset information indicating reference information for randomly searching 
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at a high speed for a subtitle of a desired time among subtitle data, and reprodicing the 
subtitle, text data induing subtitle contents to be converted into pixel cfata and then 
output, style information specifying an output style of pixel cfata and control in- 
formation for controlling the output of converted pixel data. Also, based on the parsed 
style information, text (fata is converted into pixel cfata. 

[96] Also, die graphic controller 904 controls based cm the parsed control information 

such that the converted pixel (fata is synchronized with moving picture (fata and output 
An output time point or an output position can be included in control information. 

[97] A reproducing method according to the present invention based on the data 

structure recorded on a storage medium aceordng to a preferred embedment of the 
present invention and the structure of the reproducing apparatus described above will 
now be explained 

[98] FIG. 10 is a flowchart of the steps performed by a reproducing method for 

providing subtitle information based on text correspondng to moving picture cfata 
having a plurality of playback routes according to a preferred embodiment of the 
present invention. 

[99] Referring to FIG. 10, in order to support multiple language subtitles and multiple 

story playback, first, a subtitle indication information item correspondng to a language 
selected by a user or set as a default in a reproducing apparatus is read among subtitle 
indcation information by language (Refer to FIG. 5) in step 1002. By parsing subtitle 
indexation information correspondng to the selected language, linked subtitle/video 
mapping information is read in step 1004. By parsing the read subtitle/video mapping 
information, subtitle data linked to video (fata of a route to be reproduced is read in 
step 1006. Based on style information and text information included in the read subtitle 
cfata, pixel (fata for a bitmap image graphic is generated in step 1008. Finally, by 
controlling a time and position for outputtbg a subtitle based on control information 
included in the subtitle data, the generated pixel (fata is output in step 1010. 

[100] Accordngry, the subtitle of the language selected by the user or as a default setting 
can be reproduced along the story playback route. At this time, subtide indcation in- 
formation by language, subtitle/video mapping information, or subtide data can be 
recorded on an identical storage medium on which moving picture data is recorded, or 
can be dsposed on the Internet separately, and in the latter case, the address on the 
Internet can be stored on a storage medum. 

[101] Meanwhile, referring to FIGS. 1 1 through 17, an implementation example of 

mapping information and subtide (fata implemented on a DVD dsc, as an embedment 
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on on the entire 



video title is recorded and a plurality of video title sets (VTS) are stored A video 
object set (hereinafter referred to as VOBS) is linked to the VMG. Meanwhile, to the 
VTS, a VOBS for dsplaying a menu screen and a plurality of video objects (VOBs) 
aie linked. 



VOBLI_CLIDN information are recorded such that a video object to which a current 
VOBLf unit belongs and identifier of a Cell (VOBJD and CELLJD) can be known. 
Also, C JELTM information is recorded such that a relative reproduction time from the 
first video frame of a Cell to which a current VOBLF belongs, to the first video frame 
of die current VOBLF can be known. 

[IDS] Mapping information and the structure of subtitle (fata accordng to the present 
invention based on the DVD dsc structure described above will now be explained. 

[106] FIG. 1 1 is a diagram explaining the (fata structure of mapping information shown 
in FIG. 4 implemented on a DVD disc as an embodiment (1) of the present invention. 

[107] Referring to FIG. 1 1, a storage medum accordng to die present invention includes 
a video object VOB that is arecordng unit of moving picture (fata of a DVD and 
indication information on subtitle (fata linked to the VOB. 

[108] Subtitle/video mapping information on die left hand side includes indcation in- 
formation indcating a VOBS linked to at least one or more subtities. Also, information 
indcating linking relations between VOBSs is also included. 

[109] Besides, at least one is included among language information on which language is 
used to generate subtitle data, screen dsplay title information of a subtitle, information 
on at least one or more fonts, ISRC code information of a producer who made 
subtitles, color table information to be used for a background color and foreground 
color of a subtitle character, and stream number information of a text subtitle to 
distinguish it from subtitle stream data of a subpicture method in AV stream data that 
is moving picture (fata. 

[110] - The stream number information of a text subtitle may include, for example, a 
number set to SPRM (2), which is a system register of a reproducing apparatus. 

[1 1 1] FIG. 12 is a dagram showing an example of mapping information shown in FIG. 
1 1 implemented by using a markup language on a DVD dsc as an embodment (1 ) of 
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the present invention. 

[112] Referring to FIG. 12, it can be seen that video object 1 in <vmg_vobs> tag is 
linked to a subtitle (fata file 1202, file://english_vmgm.text, vkieo object 1 in < 
vtms_vobs> tag is linked to a subtitle data file 1 204, fiIer//engEsh_jvtsm.text, and vileo 
object 1-9 in <vtstt_vobs> tag is linked to a subtitle data file 1206, 
file://english_ttlvobl.text. Besides, language information, title information, font in- 
formation, ISRC information, stream IDs, and color table information are included. 

[113] The example here uses the XML method but other encoding methods can also be 

used for presentation. That is, in the present invention, which (fata should be used is of 
importance, and the method for expressing data can be performed by selecting to use a 
markup language, or a binary table, or another method. Data that can be included in 
subtitle/video mapping information can be arranged as follows. 

[1 14] FIG. 13 is a dagram showing an example of the mapping information described in 
the form of a table implemented on a DVD dsc as an embedment (1) of the present 
invention. 

[1 15] Referring to FIG. 13, position information 1302, 1304, and 1306 of subtitle (fata 
conespondng to a video object is included. Besides, language information, title in- 
form* ition, font information, ISRC information, color table information, and stream ID 
information can be included. 

[1 16] Meanwhile, in a DVD, subtitle (fata displayed overlapping a vkleo image is 

encoded in the same manner as 2-dmensional graphic data is encoded. That is, in the 
case of a DVD, a separate encoing method to support multiple languages is not 
ernploye4 and each subtitle (fata is converted into pixel data for a bitmap image 
graphic, and then the pixel (fata is processed by one encoing method and recorded. 
Graphic (fata for a subtitle is referred to as a subpictme. A subpicture is formed with a 
subpicture unit (SPU) corresponding to one sheet of graphic data. As output control in- 
formation to output pixel data, output starting time information, color information of 
pixel (fata, information on contrast with video (fata, and information on an output time 
and a finish time are included. 

[117] FIG. 14 is a dagram explaining the structure of subtitle (fata shown in FIG. 6 im- 
plemented on a DVD dsc as an embedment (1) of the present invention. 

[118] Referring to FIG. 14, subtitle (fata accordng to an embedment (1 ) of the present 
invention includes header information, reference offset information, time information 
and/or text information. 

[119] Header information and text information are the same as explained with reference 
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to FIG. 6. 

However, the reference offset information is reference information to randomly 
search for a subtitle of a desired time at a high speed and reproduce the subtitle, and 
uses the cell identifier (VOBJDN and CELLJDN) of the vileo object (VOB) 
described above, which is used as a recording unit of a DVD storage medium. Also, as 
synchronization time information, a lapse time from a starting time point of a reference 
cell is used. In particular, synchronization time information can be expressed by using 

the basis of a reference time to reproduce 
ion specifying the output style of pixel data 
and control information for controlling output of converted pixel data can be included 
The style information and control information will be explained later. 

FIGS. 15Aandl5B are diagrams showing an example of subtitle data im- 
plemented on a DVD dsc dsplayed on a screen as a preferred embodiment (1) of the 
present invention. 

In a DVD, pixel data is losslessly coded and information on a position at which a 
subpicture of a subtitle is dsplayed (SP dsplay area) in an area to dsplay the entire 
screen, and information for controlling an output start time and finish time, an output 
direction, and line spacing are included. In a DVD, subpicture data for subtitle cfata of 
a maximum of 32 dffeient languages can be multiplexed together with moving picture 
data and recorded. Each language is distinguished by a stream id provxied by the 
MPEG system codng method and a sub stream id defined by the DVD. Accordngly, 
if a user selects one language, the corresponding subpicture unit (SPU) is extracted by 
taking only subpictures (SP_PCK) having the stream id and sub stream kl cor- 



responding to the language, and then, by d 



ibpicture 



data is extracted and accordng to output control information, the output is controlled. 

Referring to FIGS. 15A and 15B, the method for displaying a text-based subtitle 
accordng to die present invention constructed to have compatibility with the 



in i 



ricture method of a DVD dsc is shown. 
The subtitle cfata described with reference to FIG. 14 is parsed by the subtitle 
processor 840 of FIG. 8 and converted into pixel (fata having an output image as 
shown in FIGS. 15A and 1SB, and transferred to the blender 850. Accordingly, the re- 
producing apparatus accordng to the present invention can reed ve the pixel data for a 
bitmap image accordng to the present invention as the conventional bitmap-based 
subpicture data, synchronize it with video data and output on the screen. As a result, 
without medfying the structure of the conventional decoder 830, a subtitle can be 
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processed to be compatible with the conventional subpictnre method. 
[ 125] The text-based subtitle data according to the present invention has the following 
structure in order to be compatible with the subpicture method of a DVD as described 
above. 

[126] FIG. 16 is a dagram showing an example of subtitle (fata implemented by a 
markup language on a DVD disc as an embedment (1) of the present invention. 

[ 1 27] Ref erring to FIG. 1 6, when text-based subtitle cfata is ranebmly searched for, in 
order to search for the data at a high spee4 a storage medum accordng to the present 
invention uses a video object number (VOBJDN), a cell number (CELLJDN), and a 
lapse time from a cell (time) as reference offset information (1600). Also, information 
indcating next reference offset information (next) is included. 

[128] Also, text information induing the contents of a subtitle and style information 
indcating an output style are included (1602 and 1606). 

[129] Furthermore, control information for outputting pixel (fata obtained by converting a 
text subtitle after synchronization with video dhta is also included (1604 and 1608). 

[130] Preferably, in order to generate the pixel cfata as shown in FIGS. 15A and 153 

based on the subtitle dhta of FIG. 16, style information as the following is included in 
the text-based subtitle data accordng to the present invention. 

[131] It is desirable that in style information included in subtitle data accordng to the 
present invention, information on the width and height of a pixel dhta area to indcate 
the size of the pixel dhta is recorded. Preferably, also included are information on the 
color of a background screen of pixel (fata rendering subtitle text, time information on 
when pixel data is to be generated and deleted in the buffo- memory of pixel data, in- 
formation on a starting point from which the first line of subtitle text begins, in- 
formation on line spacing when a plurality of lines of subtitle text are output, in- 
formation indcating whether the output direction of text is from left to right or from 
right to left, or in the vertical or horizontal drection, information on the shape, such as 
size, bol4 and Italic, of subtitle text, line break information, and character code change 
information* 

[132] The subtitle processor 830 parses style information in subtitle (fata having the in- 
formation described above and controls the output style of subtitle text 

[1 33] Meanwhile, preferably, in order to control so that pixel (fata converted by applying 
the style information described above is synchronized with video data and output on 
die screen, die following control information is included. 

[134] Preferably, in the control information included in subtitle dhta accordng to the 
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present invention, position information ((Xs, Ys), (Xe, Ye)) specifying an area to be 
actually output on the screen among pixel data, information on a starting point in a 
pixel data area correspondng to the first starting point of a text subpicture dsplay area 
(Text SP Display Area) shown in FIG. ISA, and time information on when the bitmap 
image of pixel (fata appears and dsappears on the screen are recorded 

[135] In FIG. 16, shown is subtitle data information 1600 which when vob_U is any one 
of 1 to 5 and cell_id is 1, a subtitle is made to be output by calculating a syn- 
chronization time (sync time) on the basis of vobJtin=l-5 and celLkin=l. That is, by 
using a lapse time (time) from the video object number (VOBJDN) and cell number 
(CELL JDN) that are reference offset information, when text-based subtitle (fata is 
randomly searched for, retrieval can be quickly performed 

[136J Also, <text> tag indcates style information and subtitle text information and < 
pixmap> tag indcates control information for outputting pixel ffrta 

[137] As 'begin' or 'end' information of <pixmap> tag or <text> tag, a lapse time from a 
Cell or PTS time information calculated from the standard time clock (STC) described 
above is appropriate. Also, 'start* information of <text> tag indcates address in- 
formation of a starting point from which text is rendered and 'start' information of < 
pixmap> tag indcates information on an address from which pixel data is to be output. 

[1 38] In addtion, as an example of control information, synchronization time in- 
formation for outputting subtitle (fata synchronized with video (fata can be expressed as 
a lapse time from a reference cell of a video object, and in particular, screen output 
time (Presentation Time Stamp, PTS) information based on a STC used by a re- 
producing apparatus to reproduce video (fata can be used. 

[139] The example shown in FIG. 16 uses the XML method but this is just an example 
and the contorts of subtitle (fata induing style information and control information, 
reference offset information and header information, described above can be expressed 
by other encaing methods. A case where subtitle (fata is expressed by a binary table 
method not by the XML method will now be explained. 

[140] FIG. 17 is a dagram showing an example of subtitle (fata implemented in the form 
of a binary table on a DVD disc as an embedment (1) of die present invention. 

[141] Referring to FIG. 17, unlike in FIG. 16, an example of subtide implemented in the 
form of a binary table shape is shown. Subtitle (fata according to the present invention 
includes style information 1710, control information 1720, and text information 1730, 
and includes header information indcating starting positions of these information 
items. In pixmap #1 1712 as an example of control information, information indcating 
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the position of style information (style = '10 and die position of text information 
(text_offset = *V) is included. Acconing to this, corresponding subtitle text in- 
formation can be fount! and by applying the indcated style information, pixel data, can 
be generated and based on the control information, the output of the generated pixel 
data is controlled. 

[142] In particular, by implementing each of the style information and control in- 
formation to have a predetermined size and to be stored sequentially in a pre- 
determined area, search time for randbm search and reproduction can be reduced 
compared to the conventional XML structure such as S AMI technology and Real-text 
technology, such that efficiency of search is enhanced. 

[143] Meanwhile, referring to FIGS. 18 through 24, an implementation example of 
mapping information and subtitle cfata implemented on a bluray dsc as another 
embedment (2) of the present invention will now be explained. 

[144] In a bluray disc, an AV stream in which moving picture data is recorded is divided 
into clip units and recorded. In adftion, acconing to a presentation method similar to 
the subpicture method of a DVD, subtitle (fata is converted into pixel cfata based on a 
bitmap and processed. The structure of subtitle data and mapping information 
accenting to the present invention based on the bluray dsc structure will now be 
explained. 

[145] FIG. 18 is a dagram explaining the data structure of mapping information shown 
in FIG. 4 implemented on a bluray dsc as another embedment (2) of the present 
invention. 

[146] Referring to FIG. 18, a storage medum accordng to the present invention includes 
a clip that is a reconfng unit of moving picture cfata of a bluray dsc and indcadon in- 
formation indcating subtitle data 1802 linked to the clip. 

[147] Subtitle/video mapping information on the left hand side includes indcadon in- 
formation indcating a clip linked to at least one or more subtitles. Besides, at least one 
among language information on which language is used for subtitle cfata, screen 
dsplay title information of a subtitle, information on at least one or more fonts, ISRC 
code information of a producer making the subtitle, color table information to be used 
for a background color and a foreground color of a subtitle character, and information 
on a packet identifier (hereinafter referred to as PID) number of a text subtitle to 
distinguish from subtitle stream cfata in the subpicture method in A V stream cfata that 
is moving picture cfata is included. FED number information of a text subtitle can 
include, for example, a number set to PSR (2), which is a Player Status Register. 
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[148] FIG. 19 is a diagram showing an example of mapping information shown in FIG. 
18 implemented by using a markup language on a bhiray dsc as another embodiment 
(2) of the present invention. 

[149] Referring to FIG. 19, it can be seen thai subtitle clip file 0001 in <blu-ray-vilea> 
tag is linked to subtitle cfata file 1902, f english_0001 .text'. Besiies, language in- 
formation, title information, font information, ISRC information, information on the 
PID number of a subtitle, and color table information are included. 

[150] The example here uses the XML method but other encodng methods can also be 

used for presentation. That is, in the present invention, which cfata should be used is of 
importance, and the method for expressing data can be performed by selecting to use a 
markup language, or a binary table, or another method. Data that can be included in 
subtitle/video mapping information can be arranged as follows. 

[151] FIG. 20 is a dagram showing an example of the mapping information described in 
the form of a table implemented on a bluray dsc as another embedment (2) of the 
present invention. 

[152] Referring to FIG. 20, position information of subtitle data corresponding to a video 
clip is included (2002). Besides, language information, title information, font in- 
formation, ISRC information, color table information, and stream ID information can 
be included. 

[153] FIG. 21 is a dagram explaining the structure of subtitle data shown in FIG. 6 im- 
plemented on a bluray dsc as another embedment (2) of the present invention. 

[154] Referring to FIG. 21, subtitle data accordng to another embedment (2) of the 

present invention includes header information, reference offset information, time in- 
formation and/or text information. 

[155] Header information and text information are the same as explained with reference 
to FIG. 6. 

[156] However, the reference offset information is reference information to randomly 
search for a subtitle of a desired time at a high speed and reproduce the subtitle, and 
uses reproduction time information (presentation time stamp, PTS) of the start position 
of a clip described above, which is used as a recordng unit of a bluray dsc storage 
medium. Also, as synchronization time information, a relative time to a starting time 
. point of reproduction of a clip is used. In particular, synchronization time information 
can be expressed by using a presentation time stamp (PTS) time on the basis of a 
reference time to reproduce moving pictures. 

[157] Besides, style information specifying the output style of pixel data and control in- 
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formation for controlling output of converted pixel data can be included. The style in- 
formation and control information wiD be explained latter. 

FIGS. 22A and 22B are diagrams showing an example of subtitle (fata im- 
plemented on a bluray dsc displayed on a screen as another preferred embedment (2) 
of the present invention. 

Referring to FIGS. 22A and 22B, the subtitle data described with reference to FIG. 
21 is parsed by the subtitle processor 840 of FIG. 8 and converted into pixel (fata 
having an output image as shown in FIGS. 22A and 22B, and transferred to the blender 
850. Accordingly, the reproducing apparatus according to the present invention can 
receive the pixel data for a bitmap image according to the present invention as the con- 
ventional bitmap-based presentation (fata of a bluray dsc, synchronize it with viieo 
(fata and output on the screen. As a result, without maifying the structure of the con- 



ven 



iii 



processed 



• JH \tti\l 



ible with the 



ventional 



ion method of a bluray dsc. 
The text-based subtitle (fata according to the present invention has the following 
structure in order to be compatible with the presentation method of a bluray dsc as 
described above. 4 

FIG. 23 is a dagrarn showing an example of subtitle (fata implemented by a 
markup language on a bluray disc as another embedment (2) of the present invention. 
Referring to FIG. 23, when text-based subtitle (fata is randomly searched for, in 



or 



t to search for the data at a high spee4 a storage medum accordng to the present 

■ 

invention uses the reproduction start time point (sync-offset value) of a viieo clip. 
Also, information indcating next reference offset information (next) is included. 

Also, text information inducing the contents of a subtitle and style information 
indcating an output style are inclukd (2302 and 2306). 

Furthermore, control information for outputting pixel (fata obtained by converting a 
text subtitle after synchronization with video (fata is also included (2304 and 2308). 

Preferably, in order to generate the pixel (fata as shown in FIGS. 22A and 22B 
based on the subtitle (fata of FIG. 23, style information described with reference to 
FIG. 16 is incl 
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in the text-based subtitle data accordng to the present invention. 
The subtitle processor 830 parses style information in subtitle data having the in- 
formation described above and controls the output style of subtitle text 

Meanwhile, preferably, in order to control so that pixel data converted by applying 
the style information described above is synchronized with video (fata and output on 
the screen, the following control information is included. 
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[167] Preferably, in the control information included in subtitle (fata according to the 
present invention, position information (cropping) specifying an area to be actually 
output on the screen among pixel data, information on a starting point (pixmap 
position) in a pixel data area corresponding to the first starting point of a text 
subpicture display area (Text SP Display Area) shown in FIG. 22A, and time in- 
formation (composition begin end) on when the bitmap image of pixel data appears 
and dsappears on the screen are recorded. 

[168] In FIG. 23, subtitle (fata information for outputting a subtitle in which a re- 
production start time of a clip is '0* is shown. That is* by using the reproduction start 
time information of a clip that is reference offset information, when text-based subtitle 
data is randomly searched for, retrieval can be quickly performed. 

[169] Also, <text> tag indicates style information and subtitle text information and < 
composition> tag indicates control information for outputting pixel data. 

[1 70] As "begin or 'end 1 information of <composition> tag or <text> tag a lapse time 
from a reproduction start time of a clip or PTS time information calculated from the 
standard time clock (STQ described above is appropriate. Also, 'start* information of < 
text> tag indcates adiress information of a starting point from winch text is rendered, 
and "position' information of <pixmap> tag indcates information on an address from 
which pixel (fata is to be output 

[171] In addition, as an example of control information, synchronization time in- 
formation for outputting subtitle (fata synchronized with video data can be expressed as 
a relative time on the basis of the reproduction start time point of a video clip, and in 
particular, screen output time (Presentation Time Stamp, PTS) information based on a 
STC used by a reproducing apparatns to reproduce video data can be used. 

[172] The example shown in FIG. 23 uses the XML method but this is just an example 
and the contents of subtitle data induing style information and control information, 
reference offset information and header information, described above can be expressed 
by other encoing methods. A case where subtitle data is expressed by a binary table 
method, not by the XML method will now be explained 

[173] FIG. 24 is a diagram showing an example of subtitle (fata implemented in the form 
of a binary table on a bluray disc as another embodiment (2) of the present invention. 

[174] Referring to FIG. 24, unlike in FIG. 23, an example of subtitle implemented in the 
form of a binary table shape is shown. Subtitle (fata accordng to the present invention 
includes style information 2410, control information 2420, and text information 2430, 
and includes header information indicating starting positions of these information 
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items. The detailed structure is explained above with reference to FIG. 17. 

In particular, by implementing each of die style information and control in- 
formation to have a predetermined size and to be stored sequentially in a pre- 
determined area, search time for randbm search and reproduction can be reduced 
compared to the conventional XML structure such as S AMI technology and Real-text 
technology, such that efficiency of search is enhanced 

Optimum embedments have been explained above and are shown. However, the 
present invention is not limited to the preferred embodiment described above, and it is 
apparent that variations and mai fications by those skilled in the art can be effected 
within the spirit and scope of the present invention defined in die appended claims. 

The present invention can also be embodied as computer reabble cedes on a 
computer readable recorcing medium. The computer reacfable recorcing medium is 
any data storage device that can store data which can be thereafter read by a computer 
system. Examples of the computer readable recording medum include real-only 
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disks, optical (fata storage devices, and carrier waves (such as data transmission 
through the Internet). The computer reafable recorcing medum can also be dstributed 
over network coupled computer systems so that the computer readable code is stored 
and executed in a dstributed fashion. 
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As described above, by using the mapping information and the subtitle data file 
structure accordng to the present invention, subtitle information compatible with a 
bitmap image method such as the subpicture method of a DVD and the presentation 
method of a bhray dsc, and based on text corxespondng to moving picture data 
having a plurality of playback routes can be provided. 

Furthermore, by induing reference offset information in a subtitle data file, when 
random search or reproduction is performed the time for searching for a subtitle can 



be reduced such that search efficiency can be enhanced. 



